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Method and apfparatus for providing a video signal 



The invention relates to a method of providing a video signal for display of a 
stream of video data at a rate oilier than real-time, tihe video data being built up fiom fi:ames, 
the method comprising the step of real-time rendering of non-contiguous segments of the 
stream of video data comprising multiple subsequent frames to a fbrst rendered stream. 
S The invention fiufher relates to an apparatus for providing a video signal for display of a 
stream of video data at a rate other than real-time, the video data being built up fiom frames, 
the method comprising a first rendering unit for real-time rendering of non-contiguous 
segments of the stream of video data conqprising multiple subsequent fiames to a first 
rendered stream. 

10 The invention also relates to a record carrier comprising computer executable 

code. 

Furthermore, the invention relates to a programmed computer. 



IS An embodiment of the aforementioned method is known firom the granted US 

patent US-B-S4S7669. This document discloses a program search method including the steps 
of reproducing the program for a predetermined reproduction period after p^orming a jump 
step by a predetermined search interval and repeatedly performing the jumping and 
reproducing steps. 

20 A disadvantage of such a method is that a user easily looses track of the 

locaticm at which the program is reproduced. Especially in case of frequent scene changes 
and/or a large search interval this is the case. Firsts a user will easily loose any understanding 
of the search direction. Second, the user might miss some scenes, especially in case of 
frequent scene changes and a large search interval and in that way, loose the global 

25 understanding of the program. 



It is an objective of tiie invention to provide better user feedback using the 
aforementioned method. 
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This object is achieved ^fh fhe method according to the invenlion, 
characterised in that the method further conrprises the step of: non real-time rendering of the 
stream of video data by rendering pre-determined non subsequent frames at a speed other 
than real-time to a second rendered stream; multiplexing the first rendered stream and the 

5 second rendered stream for simultaneous display on a display device, wherein: the first 
rendered stream is displayed on a first part of the display device; and the second rendered 
stream is displayed on a second part of the disfplay device. 

By non real-time rendering of the stream of video data by rendering pre- 
determined non subsequent firames at a speed other than real-time, a stream is obtained as is 

10 usually obtained when for example fiist forwarding a film on a standard DVD player. In such 
a stream, fhe direction of the playback can easily be seen, for example when a person is 
shown who is walking backward instead of forward, esfpedally at playback speeds which are 
not too high. This type of play-back, however, has the disadvantage that it is very diEBcult to 
render synchronously with audio, while play-back with audio increases the information 

15 delivered to a user. Therefore, rendering of two streams is provided in the method according 
to the invention. 

In an embodiment of fhe method according to fhe invention, the second part of 
the display device is significantiy smaller than the fiill size of the display device and the first 
part of fhe display is fhe complement to the second part. 
20 An advantage of this embodiment is that fhe real-time rendered part of fhe 

streanoi, which is usually fhe most convenient to view for a user, of data is provided on a large 
area. The second rendered stream is provided only for navigation and orientation purposes to 
I»x>vide a global impression; therefore it is not a big problem to provide this on a small part 
of fhe display device. 

25 A further embodiment of fhe method according to fhe invention comprises fhe 

steps of providing a first bar representative of fhe stream of video data and indicating on the 
first bar a location of fhe first rendered stream that is displayed on fhe first part of tiie display 
device. 

An advantage of this embodiment is that a user is given an indication which 
30 part of the stream of audiovisual data is rendered and shown on a screen. 

Alternatively, an enibodiment according to fhe invention further comprises fhe 
steps of providing a second bar representative of fhe stream of video data and indicating on 
fhe second bar a location of fhe second rendered stream that is displayed on fhe second part 
of fhe display device. 
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Another embodiment of the method according to the invention comprises the 
step of providing an indicator indicative of the direction of the non real-time rendering. 

The apparatus according to the invention is characterised in that the apparatus 
further comprises a second rendering unit for non real-time rendering of the stream of video 
5 data by rendering pre-determined non subsequent frames at a speed other than real-time to a 
second rendered stream; and a multiplexer for multiplexing the first rendered stream and the 
second rendered stream for simultaneous display on a display device, wherein the first 
rendered stream is displayed on a first part of the display device; and tiie second rendered 
stream is displayed on a second part of the display device. 
10 With respect to the record carrier according to the invention, the computer 

executable code enables a processing unit to perform the method according to claim 1. 

The programmed computer according to thie invention is enabled to execute 
the method according to claim 1. 

15 

The invention will now be fiuther elucidated by describing enobodiments 
depicted in Figs,, wherein: 

Fig. 1 shows a consumer electronics system comprising an embodiment of the 
apparatus according to the invention; 
20 Fig. 2 shows a stream of audiovisual data to elucidate an embodiment of the 

method according to the invention; 

Fig. 3 A shows a screen to depict an embodiment of the method according to 

the invention; 

Fig. 3B shows a screen to depict another embodiment of the melliod according 
25 to the invention; 

Fig. 4A shows a screen to depict a fiirther embodiment of the melfaod 
according to the invention; 

Fig. 4 B shows a screen to depict yet another embodiment of the method 
according to the invention; and 
30 Fig. 5 shows a screen to depict yet a further embodiment of the method 

according to the invention. 
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Fig. 1 shows a consumer electromcs system 100 comprising a video 
processing apparatus 1 10 as an embodiment of the apparatus according to the invention, a 
TV-set 150 and a user control device 160. 

The video processing apparatus 1 10 comprises a harddisk drive 1 12 as an 
5 embodiment of a storage device, a buffer 1 14, a first rendering unit 1 1 6, a second rendering 
unit 1 18, a video multiplexing unit 120, a micro controller 122 for controlling the 
components of the video storage apparatus 1 10, a ROM memory 124 and a user control 
command receiver 126. 

The TV-set 150 contprises two sfpeakers 152 and a screen 154 as a display 

10 device. 

The user control device 160 comprises a first rewind button 162, a real-time 
play button 164, a &st forward button 166, a pause button 168 and a stop button 170. 

When performing fest trickplay - fest forward or fast backward - while 
displaying video data on the screen 154 according to the invention, data is retrieved fiom the 

15 harddisk drive 1 12 and stored in the bujffer 1 14. It should be mentioned that Ihe buffer 1 14 is 
optional; data can also be read directly from the harddisk drive 1 12. A buffer is, however, 
preferred since in that case, data has to be read only once from the harddisk drive 1 12, as will 
be apparent from the further description. 

Using the method according to the invention, at least two rendered streams are 

20 produced. A first rendered stream is produced by real-time rendering of non-contiguous 
segments of the stream of video data contprising multiple subsequent fi^mes by the first 
rendering unit 116. Also, a second stream is produced by non real-time rendering of the 
stream of video data by rendering pre-determined non svibsequent frames at a speed other 
than real-time by the second rendering unit 118, for example at a hi^er speed. 

25 To execute the method according to the invention, the rendering units are 

controlled by the micro controller 122 for controlling the coniponents of the video storage 
apparatus 1 10. The instractions for the mioro controller 122 for executing the method 
according to the invention are in this embodiment stored in the ROM memory 124 as an 
embodiment of the data carrier according to the invention. 

30 The operation of the video processing apparatus 110 and embodiments of the 

method according to the invention will be elucidated by Fig. 1 and by Fig. 2 depicting a 
stream of video data 200. The stream of video data 200 is built xip from frames. 

When a user iiistnicts the video processing sqpparat^ 110 to render a stream of 
video data 200 at a speed higher than real-time in fast forward mode, the user pushes the fast 
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forward button 164 on the user control device 160, The user command is received by the user 
control command receiver 126, which forwards it to the micro controller 122. The n^cro 
controller 122 instructs the buffer 1 14 to retrieve a iBrst portion of the stream 200 between the 
most left arrow of a first indicator 202 and the most left arrow of a second indicator 204 fix)m 

S the harddisk drive 112 and buffer it. 

Next, a part of the first portion of Ihe stream 200 between the most left arrow 
and most right arrow of the first indicator 202 is retrieved from the buffer 114 and is rendered 
by the first rendering unit 1 1 6 to form a first rendered stream by real-time rendering of the 
first portion of the stream 200. In tins embodiment, the first rendered stream has a pre- 

10 determined duration. 

Simultaneously, pre-determined non subsequent fiames of the first portion of 
Ihe stream 200 are retrieved fix>m the buffer 114 and rendered by the second rendering unit 
1 1 8 to provide a second rendered stream with the same pre-determined duration of tiie first 
rendered stream. The pre-determined fismes are for example intra-coded firames when the 

15 stream 200 is encoded according to the MPEG (Motion Pictures Expert Group) standard. In 
Fig, 2, they are for the first portion indicated by a first arrow 212, a second arrow 214, a third 
arrow 216 and a fourth arrow 216. 

The second and the first stream are rendered simultaneously. This means that 
as the first ftame of tiie segment indicated by the first indica 

20 rendered first stream, the firame indicated by the first arrow 212 is rendered to the second 

rendered stream. Furthermore, as the segment indicated by llie first indicator 202 is rendered, 
the fi:ames indicated by the second arrow 214, the third arrow 216 the fourth arrow 216 and a 
fifib arrow 21 8 are rendered to the second rendered stream. Subsequentiy, the first firame of 
the segment indicated by the second indicator 204 is rendered simultaneously with the fiame 

25 indicated by a sixHi arrow 220. In this way, the stream 200 is rendered at a speed &ster than 
real-time. 

This is the point where the advantage of the buffer 1 14 comes in. When the 
first portion of the stream 200 is retrieved directly firom the harddisk drive 1 12 by both 
rendering units individually, the harddisk drive 1 12 is busy for a longer time, since during 
30 rendering to obtain the second rendered stream multiple firames continuously have to be 
retrieved. When they are retrieved at once, the harddisk drive 1 12 is available for further 
processes. 

Advantageously, only Ihe part of the first portion of the stream 200 between 
the most left arrow and most ri^ arrow of the first indicator 202 and Ihe firames indicated by 
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fhe first arrow 212, the second arrow 214, the third arrow 216 and the fourth arrow 216 are 
buffered 

When the first portion of the stream 200 between the most left arrow and most 
right arrow of the first indicator 202 and the pre-determined fi-ames of the first portion are 
5 rendered, a second portion of the stream 200 between a fifth arrow 220 and a sixth arrow 228 
is retrieved fi:om the harddisk drive 1 12 and stored in the buffer 1 14 for further rendering. 

Both rendered streams are sent to the video multiplexing unit 120, where they 
are multiplexed to be displayed simultaneously on the screen 1S4, wherein each rendered 
stream is dissplayed in a {xre-determined part of the screen 154. 

10 Advantageously, sound is rendered and provided to the TV-set as well, 

accompanying the first rendered stream. The sound is {xrovided to a user via the two speakers 
152. The sound is provided at the speed of Hie first stream, which is preferably real-time. 

As the first stream comprises non-contiguous segments, rendered in real-time 
and the second stream comprises 

15 It will be apparent to a person skilled in the art that additional features are 

needed for properly providing a signal to the TV-set 150, like a D/A converter. However, 
since they are apparent, the have been omitted in Fig. 1 for sake of simplicity and overview. 
When the stream 200 is conq>ressed and/ or encrypted, the multiplexmg may 
take place either in Ifae compressed and/ or encrypted domain or in the non-compressed and/ 

20 or decrypted domain. In the first case, the rendering units are replaced by simple processing 
units retrieving the proper firames fix>m Ifae buffer 114 and the actual rendering is done after 
multiplexing. In this case, an additional rendering unit (not shown) has to be inserted in the 
video processing £^aratus 1 10. 

In Ifae latter case, the decryption and/ or decompression is performed by the 

25 rendering units or by separate decryption and/ or decoinpression units that are placed 

between the harddisk drive 1 12 and the rendering units. There are several embodiments for 
this; in one embodiment, one rendering unit (not shown) is placed between the harddisk drive 
112 and the buffer 1 14. In a further embodiment, a first decryption (or decompression) unit is 
placed between the buffer 1 14 and the first rendering unit 116 and a second first decryption 

30 (or decompression) unit is placed between the buffer 1 14 and the second rendering unit 116. 
This kind of additions to and permutations of the elements of the embodiment described are 
obvious by a person skilled in the art and can be performed without departing firom Ifae scope 
of Ifae invention. 
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When the stream of video data 200 is displayed using the method according to 
the invention, wherein each rendered stream is displayed on a pre-determined part of the 
display device 154, various embodiments are possible, some of which are presented by Fig. 
3AandFig. 3B. 

5 Fig. 3A shows the TV-set 150 with the screen 154 on which a first part 310 

and a second part 320 are indicated, both parts occupjdng half the area of the screen to 
elucidated an embodiment of the method according to the invention. A first rendered stream 
obtained by real-time rendering of non-contiguous segments of a stream of video data 
comprising multq)le subsequent fiames is displayed on the first part 310 and a second 
10 rendered stream obtained by non real-time rendering of Ihe stream of video data by rendering 
pre-determined non subsequent fiames at a speed higher than real-time is displayed on the 
second part 320. 

Fig. 3B shows the TV-set 150 with the screen 154 on which a first part 340 
and a second part 350 are indicated to elucidate a further embodiment of the method 
1 5 according to the invention, wherein the second part 350 is substantially smaller than the first 
part 340- A first rendered stream obtained as described in the previous paragr^h is displayed 
on the first part 340 and a second rendered stream obtained as described in the previous 

I*: 

paragraph is dissplayed on the second part 350. 

It will be apparent for a person skilled in the art that a fiirther embodiment of : . 
20 the invention is possible, wherein the first rendered stream is displayed on tiie second part 
350 and Ihe second rendered stream is displayed on the first part 340. In anotiier 
embodiment, a user may even switch between both modes described here, swap the displayed 
streams in the first part 340 and the second part 350. 

To ftirther enhance navigation of a user through a stream of video data during 
25 trickplay wherein the stream is displayed using an embodiment of the melhod according to 
the invention, navigation bars are introduced according to an embodiment of the invention. 
This is elucidated by Fig. 4A and Fig. 4B, 

Fig. 4A shows the TV-set 150 with the screen 154 on which a first part 410 
and a second part 420 are indicated. A first rendered stream obtained as desoibed above is 
30 displayed on the first part 410 and a second rendered stream obtained as described above is 
disfplayed on the second part 420. Furthermore, a first bar 412 with a first indicator 414 and a 
second bar 422 with a second indicator 424 are displayed on the screen 154. 

Both bars represent at least a portion of a stream of video data that is displayed 
on the screen 154. The first bar 412 is disfplayed on the first part 410 of the screen 154 and 
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fhe first mdicator 414 indicates the location at which the stream of video data is displayed on 
the first part 410. The second bar 422 is displayed on the second part 420 of the screen 154 
and the second indicator 424 indicates the location at which the stream of video data is 
displayed on the second part 420. 

5 Fig, 4B shows the TV-set 150 with the screen 1 54 on which a first part 440 

and a second part 450 are indicated. A first rendered stream obtained as described above is 
displayed on the first part 440 and a second rendered stream obtained as described above is 
displayed on the second part 450. Furthermore, a bar 462 with a first indicator 464 and a 
second indicator 466 are displayed on the screen 154. 

10 The bar 462 represents at least a portion ofa stream of video data that is 

displayed on the screen 154. The first indicator 464 indicates the location at which the stream 
of video data is disfplayed on the first part 440. The second indicator 466 indicate the 
location at which the stream of video data is displayed on the second part 450. 

In a fijrther embodiment borders with different colours are placed around the 

15 first part 440 and the second part 450. A colour surrounding the first part corresponds with 
the first indicator 464 and a colour surrounding the second part corresponds with the second 
indicator 466. 

When non-contiguous segments of a stream of video data to be displayed in 
real-time using the method according to the invention, it might be difficult for a user to keep 

20 track of the direction in which the video data is rendered, i.e. backward or forward. To 

fiicilitate the user feedback, in an embodiment of the invention, an indicator is provided that 
indicates tibie direction of Ihe rendering. This indicator for exsaople has the shape of an arrow, 
pointing either to Hie left side (baclcwaid rendering) or to the ri^t side (forward rendering). 

This is indicated in Fig. 5, depicting the TV-set 150 with the screen 154, a first 

25 region 5 10, a second region 520 and an indicator 530 indicating that the rendering direction 
of die video is forward. 

It will be apparent to any person skilled in the art that numerous variations 
based on the embodiments described are possible without departing from the scope of the 
invention. Process steps performed by multiple elements can be grouped and performed by 

30 only one processing element and on the other hand, processing steps performing multiple 
steps in the embodiments may just as well be tak^ apart and performed by multiple 
processing blocks. This also means that all process steps can be performed by a single 
processor of a programmed computer. 
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In summaiy. The mvention relates to a method of providing a video signal for 
display of a stream of video data at a rate other than real-time, the video data being built up 
from frames, the method comprising the step of real-time rendering of non-contiguous 
segments of the stream of video data comprising multiple subsequent frames to a first 

5 rendered stream; wherein the method further comprises the step of non real-time rendering of 
the stream of video data by rendering pre-determined non subsequent frames at a speed other 
than real-time to a second r^dered stream; multiplexing Hie first rend^ed stream and the 
second rendered stream for simultaneous display on a display device, wherein: the first 
rendered stream is displayed on a first part of the display device; and the second rendered 

10 stream is displayed on a second part of the display device. 
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1 . Method of providing a video signal for display of a stream (200) of video data 

at a rate other Hian real-time, the video data being built up from frames (212), the method 
comprising the step of real-time rendering of non-contiguous segments (202) of the stream of 
video data comprising multiple subsequent frames to a first tendered stream; 
S characterised in tiiat the method frirther comprises the step of: 

(a) non real-time rendering of the stream of video data by r^dering pre-determined non 
subsequent frames at a speed other than real-time to a second rendered stream; 

(b) multiplexing the first rendered stream and Ifae second rendered stream for 
simultaneous display on a display device (ISO), wherein: 

10 i) the first rendered stream is displayed on a first part (310) of the display 

device; and 

ii) the second rendered stream is displayed on a second part (320) of the display 
device. 

IS 2. Method according to claim 1, wherein the second part of the display device is 

significantiy smaller than the full size of the display device and the first part of the display is 
the complement to the second part. 

3. Method according to claim 1 , wherein the first part of the display device is 

20 significantiy smaller than the fiill size of the display device and the second part of the display 
is the complement to the second part. 

4. Method according to claim 1 , wherein the first part of the display device and 
the second part of the display device have mutually equal sizes. 

2S 

5. Method according to claim 1 , wherein the method finrtiier comprises the steps 
of: 

(a) providing a first bar (412) representative of the stream of video data; 
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(b) indicating on the first bar the location of the first rendered stream that is displayed on 
the first part of the display device. 

6. Method according to claim 1 , wherein the method fiirther comprises the steps 
of 

(a) providing a second bar (422) rqpresentative of the stream of video data; 

(b) indicating on the second bar a location of the second rendered stream that is displayed 
on the second part of the display device. 

7. Method according to claim 1, wherein the method finrther comprise the steps 
of claim 5 and claim 6. 

8. Method according to claim 5, wherein the method fiirther comprises the step 
of indicating on the first bar a location of the second rendered stream fiiat is displayed on ibe 
second part of the display device. 

9. Method according tot claim 1, wherein the melhod flnther conqwises the step 
of providing an indicator indicative of the direction of the non real-time rendering. 

10. Method according to claim 1, further comprising the step of providing an 
audio signal at real-time, ^chronised with the first rendered stream. 

11. >^>paratus (110) fiar providing a video signal fcxt display of a stream (200) of 
video data at a rate other flian real-time, the video data being built up &om fiames (212), tiie 
method comprising a first rendering unit (1 16) for real-time rendering of non-contiguous 
segments (202) of the stream of video data comprising multiple subsequent fiames to a first 
rendered stream; 

characterised in that the apparatus further comprises: 

(a) a second rendering unit (1 1 8) for non real-time rendering of the stream of vitteo data 
by rendering pre-determined non subsequent firames at a speed other than real-time to 
a second rendered stream; and 

(b) a multiplexer (120) for multiplexing the first rendered stream and the second rendered 
stream for simultaneous display on a display device (150), wherein: 
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i) the first rendered stream is displayed on a first part (3 1 0) of the display device; 
and 

ii) the second rendered stream is displayed on a second part (320) of the display 
device. 

12. Record carder (124) comprising computer executable code, wherein the 

conqputer executable code enables a processing unit to perform the method according to 
claim 1. 



10 13. Programmed computer programmed to execute the method according to claim 

1. 
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The invention relates to a method of providing a video signal for display of a 
stream of video data (200) at a rate other than real-time, the video data being built up fiDom 
frames, the method comprising the step of real-time rendering of non-contiguous segments of 
the stream of video data comprising multiple subsequent frames to a first rendered stream; 
5 wherein the method fiirfher con^rises the step of non real-time rendering of the stream of 
video data by rendering pre-determined non subsequent frames at a speed other than real- 
time to a second rendered stream; multiplexing the first rendered stream and the second 
rendered stream for simultaneous display on a display device (150), wherein: the first 
rendered stream is displayed on a first part (310) of the display device; and the second 
10 rendered stream is displayed on a second part (320) of the display device. 
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